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Abstract:  In  recent  papers  [14],  [16],  a  new  class  of  model- 
free  (i.e.,  the  3-dimensional  task-space  model  of  the  object  is 
unknown)  visual  servoing  methods  was  proposed  that  are  based 
on  the  estimation  of  the  relative  camera  orientation  between  two 
views  of  an  object.  By  utilizing  homography-based  techniques, 
the  control  problem  is  decoupled  by  separating  the  rotation  and 
translation  components.  A  single  controller  is  used  to  control 
the  rotation  component,  and  the  class  members  consist  of  var¬ 
ious  translation  controllers.  Each  of  the  current  class  members 
has  been  proven  to  yield  asymptotic  regulation  in  the  presence 
of  uncertainty  in  the  intrinsic  and  extrinsic  calibration  parame¬ 
ters.  New  control  development  and  stability  analysis  techniques 
are  crafted  in  this  paper  to  develop  a  new  translation  controller 
that  yields  exponential  rotation  and  translation  regulation  in 
the  presence  of  uncertainty  in  the  intrinsic  and  extrinsic  cali¬ 
bration  parameters.  Extensions  to  this  research  can  be  used  to 
yield  exponential  regulation  by  the  other  translation  controllers 
in  the  asymptotic  class  presented  in  [14]. 

I.  Introduction 

Motivated  by  the  significant  impact  that  may  be  realized  by 
enabling  robotic  systems  with  the  ability  to  perform  tasks  based 
on  a  sense  of  perception,  a  myriad  of  research  has  been  directed 
at  vision  related  issues.  One  issue  that  has  limited  the  robust¬ 
ness  of  vision-based  robotic  control  systems  is  the  lack  of  depth 
information  since  the  image-space  is  a  2-dimensional  (2D)  pro¬ 
jection  of  the  3D  task-space.  To  compensate  for  the  lack  of 
depth  information  two  mainstream  approaches  have  been  de¬ 
veloped.  The  first  approach  requires  a  3D  task-space  model  of 
the  object  so  that  the  depth  can  be  estimated  from  the  distance 
between  image  feature  points.  The  second  approach  requires 
a  stereo-based  camera  configuration;  however,  the  requirement 
for  two  cameras  increases  the  cost  and  computational  and  power 
requirements  of  the  system  while  reducing  the  overall  system  re¬ 
liability.  Another  issue  that  has  limited  the  robustness  of  vision- 
based  robotic  control  systems  is  the  potential  for  corrupt  sensor 
data  due  to  the  lack  of  exact  camera  calibration.  Specifically, 
based  on  the  fact  that  the  camera  output  is  in  the  image-space 
and  robot  controllers  are  computed  in  terms  of  the  task-space 
(joint  space),  an  optic  model  is  often  employed  to  relate  image- 
space  data  to  the  task-space.  To  relate  the  image-space  to  the 
task-space,  both  intrinsic  and  extrinsic  parameters1  of  the  optic 
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model  are  required.  If  these  parameters  are  not  exactly  known, 
then  performance  degradation  and  potential  unpredictable  re¬ 
sponse  from  the  system  may  occur.  Motivated  by  the  desire 
to  incorporate  robustness  to  these  parameters,  several  adaptive 
and  robust  controllers  have  been  designed  (e.g.,  see  [7],  [12], 
[13],  [18]).  Unfortunately,  much  of  the  previous  work  either 
constrains  the  visual  servoing  problem  to  a  planar  case  or  relies 
on  one  of  the  aforementioned  methods  to  estimate  the  object 
depth. 

Due  to  advances  in  computer  vision,  a  new  class  of  monocu¬ 
lar  visual  servo  controllers  has  been  recently  developed  by  Malis 
and  Chaumette  in  [14]  that  only  requires  the  relative  informa¬ 
tion  between  a  desired  (reference)  image  and  the  current  image. 
Moreover,  the  stability  of  these  controllers  can  be  proven  despite 
the  lack  of  exact  knowledge  of  the  camera  calibration  parame¬ 
ters.  To  achieve  these  advancements,  the  model-free  class  of 
controllers  exploits  the  relative  information  between  a  desired 
image  and  the  current  image  to  construct  a  Euclidean  homog- 
raphy  that  can  be  used  to  decouple  the  rotation  and  translation 
components  of  the  visual  servo  problem.  This  decoupling  strat¬ 
egy  has  been  recently  exploited  to  develop  a  series  of  results. 
For  example,  in  a  series  of  papers  by  Malis  and  Chaumette 
(e.g.,  [1],  [2],  [15],  and  [16])  various  kinematic  control  strate¬ 
gies  (coined  2.5D  visual  servo  controllers)  exploit  information 
from  the  task-space  (obtained  through  a  projective  Euclidean 
reconstruction  from  the  image  data)  to  regulate  the  rotation 
error  system,  while  information  from  the  2D  image-space  is  uti¬ 
lized  to  control  the  translation  error  system.  In  [6],  Deguchi 
developed  two  algorithms  to  decouple  the  rotation  and  trans¬ 
lation  components  using  a  homography  and  an  epipolar  con¬ 
dition.  Specifically,  Deguchi  decomposes  the  translation  and 
rotation  components  through  a  homography  and  states  that 
the  2.5D  controller  given  in  [2]  can  be  utilized.  As  an  alter¬ 
nate  method,  Deguchi  also  develops  a  kinematic  controller  in 
[6]  that  utilizes  task-space  information  to  regulate  the  transla¬ 
tion  error  and  image-space  information  to  regulate  the  rotation 
error.  More  recently,  Corke  and  Hutchinson  [5]  also  developed 
a  hybrid  image-based  visual  servoing  scheme  that  decouples  ro¬ 
tation  and  translation  components  about  the  z-axis  from  the 
remaining  degrees  of  freedom.  Motivated  by  the  desire  to  ac¬ 
tively  compensate  for  the  aforementioned  depth  information,  [3] 
developed  an  adaptive  kinematic  controller  to  ensure  uniformly 
ultimately  bounded  (UUB)  set-point  regulation  of  the  image 
space  errors  while  compensating  for  the  unknown  depth  infor¬ 
mation,  provided  conditions  on  the  translational  velocity  and 
the  bounds  on  uncertain  depth  parameters  are  satisfied.  In  [4], 
Conticelli  et  al.  proposed  a  3D  depth  estimation  procedure  that 
exploits  a  prediction  error  provided  a  positive  definite  condition 
on  the  interaction  matrix  is  satisfied.  In  [17],  Taylor  et  al.  devel¬ 
oped  a  kinematic  controller  that  utilizes  a  constant,  best-guess 


0-7803-7924-1/03/$!  7.00  ©2003  IEEE 


5390 


Report  Documentation  Page 

Form  Approved 

OMB  No.  0704-0188 

Public  reporting  burden  for  the  collection  of  information  is  estimated  to  average  1  hour  per  response,  including  the  time  for  reviewing  instructions,  searching  existing  data  sources,  gathering  and 
maintaining  the  data  needed,  and  completing  and  reviewing  the  collection  of  information.  Send  comments  regarding  this  burden  estimate  or  any  other  aspect  of  this  collection  of  information, 
including  suggestions  for  reducing  this  burden,  to  Washington  Headquarters  Services,  Directorate  for  Information  Operations  and  Reports,  1215  Jefferson  Davis  Highway,  Suite  1204,  Arlington 

VA  22202-4302.  Respondents  should  be  aware  that  notwithstanding  any  other  provision  of  law,  no  person  shall  be  subject  to  a  penalty  for  failing  to  comply  with  a  collection  of  information  if  it 
does  not  display  a  currently  valid  OMB  control  number. 

1.  REPORT  DATE 

2003 

2.  REPORT  TYPE 

3.  DATES  COVERED 

00-00-2003  to  00-00-2003 

4.  TITLE  AND  SUBTITLE 

An  Exponential  Class  of  Model-Free  Visual  Servoing  Controllers  in  the 
Presence  of  Uncertain  Camera  Calibration 

5a.  CONTRACT  NUMBER 

5b.  GRANT  NUMBER 

5c.  PROGRAM  ELEMENT  NUMBER 

6.  AUTHOR(S) 

5d.  PROJECT  NUMBER 

5e.  TASK  NUMBER 

5f.  WORK  UNIT  NUMBER 

7.  PERFORMING  ORGANIZATION  NAME(S)  AND  ADDRESS(ES) 

Clemson  University, Department  of  Electrical  and  Computer 

Engineering,  Clemson,  SC, 29634-0915 

8.  PERFORMING  ORGANIZATION 

REPORT  NUMBER 

9.  SPONSORING/MONITORING  AGENCY  NAME(S)  AND  ADDRESS(ES) 

10.  SPONSOR/MONITOR'S  ACRONYM(S) 

11.  SPONSOR/MONITOR'S  REPORT 
NUMBER(S) 

12.  DISTRIBUTION/AVAILABILITY  STATEMENT 

Approved  for  public  release;  distribution  unlimited 

13.  SUPPLEMENTARY  NOTES 

Proc.  of  the  2003  IEEE  Conference  on  Decision  and  Control,  Maui,  Hawaii,  U.S.A.,Dec.  2003,  pp.5390-5395 


14.  ABSTRACT 

In  recent  papers  [14],  [16],  a  new  class  of  modelfree  (i.e.,  the  3-dimensional  task-space  model  of  the  object 
is  unknown)  visual  servoing  methods  was  proposed  that  are  based  on  the  estimation  of  the  relative  camera 
orientation  between  two  views  of  an  object.  By  utilizing  homography-based  techniques,  the  control 
problem  is  decoupled  by  separating  the  rotation  and  translation  components.  A  single  controller  is  used  to 
control  the  rotation  component,  and  the  class  members  consist  of  various  translation  controllers.  Each  of 
the  current  class  members  has  been  proven  to  yield  asymptotic  regulation  in  the  presence  of  uncertainty  in 
the  intrinsic  and  extrinsic  calibration  parameters.  New  control  development  and  stability  analysis 
techniques  are  crafted  in  this  paper  to  develop  a  new  translation  controller  that  yields  exponential  rotation 
and  translation  regulation  in  the  presence  of  uncertainty  in  the  intrinsic  and  extrinsic  calibration 
parameters.  Extensions  to  this  research  can  be  used  to  yield  exponential  regulation  by  the  other  translation 
controllers  in  the  asymptotic  class  presented  in  [14]. 


15.  SUBJECT  TERMS 


16.  SECURITY  CLASSIFICATION  OF: 

17.  LIMITATION  OF 

ABSTRACT 

18.  NUMBER 

OF  PAGES 

19a.  NAME  OF 

RESPONSIBLE  PERSON 

a.  REPORT 

unclassified 

b.  ABSTRACT 

unclassified 

c.  THIS  PAGE 

unclassified 

Same  as 
Report  (SAR) 

6 

Standard  Form  298  (Rev.  8-98) 

Prescribed  by  ANSI  Std  Z39-18 


estimate  of  the  calibration  parameters  to  achieve  local  set-point 
regulation;  although,  several  conditions  on  the  rotation  and  cal¬ 
ibration  matrix  are  required.  In  [9],  Fang  et  al.  recently  devel¬ 
oped  a  2.5D  visual  servo  controller  to  asymptotically  regulate 
a  manipulator  end-effector  by  exploiting  Lyapunov-based  tech¬ 
niques  to  develop  an  adaptive  update  law  that  compensated  for 
an  unknown  depth  parameter.  Built  on  the  results  of  [9],  Fang 
et  al.  designed  a  homography-based  visual  servo  controller  in 
[10]  that  asymptotically  regulates  the  position  of  a  wheeled  mo¬ 
bile  robot  despite  nonholonomic  constraints  and  parametric  un¬ 
certainty  in  the  depth  parameter.  Although  the  results  in  [9] 
and  [10]  were  achieved  despite  unknown  depth  information,  the 
intrinsic  and  extrinsic  camera  parameters  were  required  to  be 
known;  hence,  motivation  exists  to  develop  controllers  that  are 
robust  to  uncertain  intrinsic  and  extrinsic  camera  parameters. 

In  this  paper,  we  extend  the  class  of  model-free  controllers  in 
[14]  to  include  controllers  that  yield  exponential  translation  (as 
opposed  to  the  asymptotic  results  in  [14]).  That  is,  based  on  the 
same  rotation  controller  as  the  previous  asymptotic  controllers, 
new  control  development  and  stability  analysis  techniques  are 
crafted  in  this  paper  to  develop  a  new  translation  controller 
that  yields  an  exponential  result.  For  completeness  and  to  pro¬ 
vide  foundation  for  subsequent  development,  we  first  develop  a 
closed-loop  error  system  and  stability  theorem  for  the  rotation 
controller  that  is  developed  in  [14].  We  then  develop  a  new  hy¬ 
brid  translation  controller  in  the  presence  of  uncertainty  in  the 
intrinsic  and  extrinsic  camera  calibration  parameters.  In  con¬ 
trast  to  the  asymptotic  results  developed  in  [14],  the  controller 
is  proven  to  yield  exponential  stability  results.  Specifically,  the 
authors  of  [14]  relied  on  linearization  methods  (e.g.,  Theorem 
2  of  [14])  or  perturbation-based  analysis  methods  to  conclude 
local  or  practically  global  asymptotic  stability.  The  term  prac¬ 
tically  global  is  used  in  lieu  of  global  since  the  result  is  not  valid 
for  the  singular  point  associated  with  the  angle  of  rotation  or  for 
nonpositive  values  for  the  depth  from  the  camera  to  the  target 
object.  The  results  in  this  paper  are  developed  by  a  nonlinear 
Lyapunov-based  approach  and  formal  stability  proofs  can  be 
developed  to  prove  practically  global  exponential  rotation  and 
translation  regulation. 

II.  Model  Development 
A.  Camera  Model 

Consider  two  orthogonal  coordinate  systems,  denoted  by  F 
and  F* ,  where  F  is  attached  to  a  camera  that  is  held  by  the 
robot  end-effector,  and  F *  is  a  fixed  coordinate  system  that 
represents  the  constant,  desired  position  and  orientation  of  F. 
Also  consider  a  reference  plane  ir  that  is  defined  by  four2  target 
points  Oi  Vi  =  1,  2,  3,  4  where  the  actual  and  desired  3D 
coordinates  of  Oi  expressed  in  terms  of  F  and  F*  are  denoted 
by  Xi  (t)  ,Y,  (t) ,  Zi  (t)  G  R  and  X*,Y*,Z*  G  R,  respectively, 
and  are  defined  as  elements  of  fhi  (t),  fh*  G  R 3  as  follows  (see 
Figure  1) 


fhi  =  [  Xi  Vi  Zi  ]T  (1) 

ml  =  [  X*  Y*  Z*  }T .  (2) 


Since  the  task-space  is  projected  onto  the  image-space,  normal¬ 
ized  coordinates,  denoted  by  rrij  (f),  ml,  of  the  targets  points 


m,  ( t )  and  m* ,  respectively,  can  be  defined  as  follows 
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where  the  standard  assumption  is  made  that  Zi  ( t )  >  0  and 

Z*  >  0. 

In  addition  to  having  a  task-space  coordinate,  each  target 
point  will  also  have  a  projected  pixel  coordinate  expressed  in 
terms  of  F  denoted  by  m  ( t )  ,  v,  (t)  6  R,  which  are  defined  as 
elements  of  pi  (f)  as  follows 

Pi  =  [  Ui  Vi  1  ] T  (5) 


where  the  projected  pixel  coordinates  of  the  target  points  are  re¬ 
lated  to  the  normalized  task-space  coordinates  by  the  following 
global  invertible  transformation 


Pi  =  Ami  (6) 

where  A  G  R3x3  is  a  known,  constant,  and  invertible  intrinsic 
camera  calibration  matrix  that  is  explicitly  defined  as  [15] 


A  = 


fkn 

0 

0 


—fku  cot  4>  uo 


siiufi 

0  1 


(7) 


In  (7),  the  constant  parameters  uo,  no  G  R  denote  the  pixel 
coordinates  of  the  principal  point  (i.e. ,  the  image  center  that  is 
defined  as  the  frame  buffer  coordinates  of  the  intersection  of  the 
optical  axis  with  the  image  plane) ,  ku,  kv  G  R  represent  camera 
scaling  factors,  <t>  G  R  is  the  angle  between  the  camera  axes,  and 
/  G  R  denotes  the  camera  focal  length.  Similarly,  the  constant, 
desired  pixel  coordinates  expressed  in  terms  of  F *  denoted  by 
u*  ,v*  G  R,  are  defined  as  elements  of  p*  as  follows 

P*  =  [  ul  v*  1  ]T  (8) 

and  can  be  related  to  the  normalized  coordinates  m *  by  the 
following  relationship 

p*  =  Am *.  (9) 

From  (6)  and  (9),  it  is  clear  that  the  normalized  task-space 
coordinates  of  a  feature  point  can  be  determined  from  the  pixel 
coordinates  of  the  point.  However,  this  relationship  requires 
the  intrinsic  calibration  parameters  to  be  exactly  known.  Since 
the  intrinsic  camera  calibration  matrix  A  is  difficult  to  exactly 
determine  in  practice,  the  computed  normalized  coordinates  are 
actually  estimates,  denoted  by  fhi  ( t ) ,  m*  G  R3,  of  the  true 
values.  These  estimates  can  be  expressed  as  follows  [14] 


fhi  =  A  xpi  =  Ami  (10) 

fh 1  =  A~1p*  =  Ami  (11) 

where  A  G  R3x3  denotes  a  best-guess  estimate  of  the  intrinsic 
camera  calibration  matrix  A,  and  the  calibration  error  matrix 
A  G  R3x3  is  defined  as  follows 


A  =  A~1a  = 


An 

A]_2 
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A22 

A22 

0 
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2In  general,  only  3  points  are  required  to  define  a  plane,  however,  in  the 
subsequent  analysis,  4  target  points  located  on  the  plane  ir  are  required. 


where  An,  A12,  A13,  A22,  A23  E  R  denote  unknown  intrinsic 
calibration  mismatch  constants. 
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B.  Homography  Development 

Based  on  geometric  relationships  between  the  desired  image 
of  a  target  and  the  current  target  image  (see  Figure  1),  rrii(t ) 
and  m*  can  be  related  as  follows  [9]  [15] 

rrii  =  a.iHm*  (13) 


where  on  (f)  £  R  is  an  unknown  scaling  factor  defined  as 


Oti  = 


zx 

~zl' 


(14) 


and  H{t)  £  R3x3 


denotes  the  following  Euclidean  homography 


Fig.  1.  Motion  and  structure  parameters 


H  =  R  +  Xhn*T.  (15) 

In  (15),  R  (t)  £  50(3)  denotes  the  rotation  from  the  desired 
task-space  coordinates  to  the  actual  task-space  coordinates  of 
the  camera,  n*  £  R3  denotes  the  constant  unit  normal  from  F * 
to  7 r,  and  Xh  ( t )  £  R3  is  related  to  the  actual  translation  vector 
from  F  to  F* ,  denoted  by  Xf  ( t )  £  R3,  as  follows 

Xf  =  Xhd*  (16) 

where  d*  £  R  denotes  a  constant,  unknown  distance  from  F * 
to  7r.  Since  rm(t )  and  m *  can  not  be  exactly  determined,  the 
estimates  in  (10)  and  (11)  can  be  substituted  into  (13)  to  obtain 
the  following  relationship 

rhi  =  aiHm*  (17) 

where  H  (f)  £  R3x3  denotes  the  estimated  Euclidean  homogra- 
phy  [14] 

H  =  AHA-1.  (18) 

Since  rhi{t)  and  m*  can  be  determined  from  (10)  and  (11),  a  set 
of  12  linear  equations  can  be  developed  from  the  4  image  point 
pairs,  and  (17)  can  be  used  to  solve  for  H  (t)  (see  [9]  for  addi¬ 
tional  details  regarding  the  set  of  linear  equations).  Provided 
additional  information  is  available  (e.g.,  at  least  4  vanishing 
points),  various  techniques  can  be  used  to  decompose  H(t)  to 
obtain  the  estimated  rotation  and  translation  components  as 
follows 

H  =  R  +  Xhn*T  (19) 

where  R  (t)  £  R3x3  is  related  to  R  ( t )  as  follows 


C.  Control  Objective 

The  objective  of  this  new  class  of  controllers  is  to  ensure  that 
the  position/orientation  of  the  camera  coordinate  frame  F  is 
regulated  to  the  desired  position/orientation  F*.  The  camera 
is  mounted  on  the  end-effector  of  a  robot  manipulator.  Hence, 
to  control  the  position/orientation  of  F,  a  relationship  is  re¬ 
quired  to  relate  the  linear  and  angular  camera  velocities  to  the 
linear  and  angular  velocities  of  the  robot  end-effector  (i.e.,  the 
actual  kinematic  control  input  signals).  This  relationship  is  de¬ 
pendent  on  the  extrinsic  calibration  parameters  related  to  the 
position  and  orientation  of  the  camera  with  respect  to  the  end- 
effector.  Specifically,  the  relationship  between  the  linear  and 
angular  velocity  of  the  camera  with  respect  to  the  end-effector 
can  be  determined  as  follows  [14] 


Vc 

Rr 

[tr]  x  Rr 

Vr 

i 0C 

0 

Rr 

UJr 

where  vc{t),  ujc{t)  £  R3  denote  the  linear  and  angular  velocity 
of  the  camera,  respectively,  while  vr(t),  cor(t)  £  R3  represent 
the  respective  linear  velocity  and  angular  velocity  of  the  end- 
effector,  Rr  £  50(3)  is  the  unknown  constant  rotation  between 
camera  and  end-effector  frames,  and  tr  £  R3  denotes  the  un¬ 
known  constant  translation  between  camera  and  end-effector 
frames  ( Rr  and  tr  consist  of  the  so-called  camera  extrinsic  ma¬ 
trix)  . 

Based  on  the  development  given  in  Section  II-B,  it  can  be 
shown  that  the  control  objective  is  achieved  if  the  Euclidean 
homography  H  ( t )  approaches  the  identity  matrix.  Mathemati¬ 
cally,  it  can  be  shown  that  if 


R  =  ARA~\  (20) 

and  Xh  (t)  £  R3 ,  h*T  £  R3  denote  the  estimate  of  Xh  {t)  and  n*, 
respectively,  and  are  defined  as  follows 

Xh  =  yAxh  n*  =  —A~Tn*  (21) 

7 

where  7  £  R  denotes  the  following  positive  constant 

7=  |i_Tn*|  .  (22) 

Remark  1:  Vanishing  points  are  points  on  the  plane  at  in¬ 
finity.  As  the  reference  plane  7r  approaches  infinity,  the  scaling 
term  d*  also  approaches  infinity,  and  Xh(t),  Xh(t)  approach  zero. 
Hence,  (19)  can  be  used  to  conclude  that  H(t)  =  R(t)  on  the 
plane  at  infinity,  and  the  four  vanishing  point  pairs  can  be  used 
along  with  (17)  to  determine  R(t).  Once  R{t)  has  been  deter¬ 
mined,  then  the  original  four  image  point  pairs  can  be  used  to 
determine  Xh(t)  and  h*(t). 


R{t)  ->  I3,  (24) 

and  one  target  point  is  regulated  to  its  desired  location  in  the 
sense  that 

— >  m*  (25) 

then  the  Euclidean  homography  approaches  the  identity  matrix 
as  follows 

H(t)  I3.  (26) 

In  the  subsequent  analysis  for  the  rotation  controller,  the  ob¬ 
jective  is  to  force  the  angle  of  rotation  to  zero.  If  the  angle  of 
rotation  is  zero,  then  the  objective  in  (24)  will  be  met.  In  the 
analysis  for  the  subsequent  hybrid  controllers,  the  objective  is 
to  prove  that  rm{t)  — >  m*  and  that  Zi(t)  — >  Z\ .  If  rm{t)  — »  m* 
and  Zi(t)  — >  Z *  ,  then  (l)-(4)  can  be  used  to  conclude  that 
the  objective  in  (25)  will  be  met.  Provided  these  objectives  can 
be  met  with  an  exponential  rate  of  convergence,  then  the  main 
objective  in  (26)  will  be  satisfied  exponentially  fast. 
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III.  Rotation  Control 

To  quantify  the  rotation  mismatch  between  F  and  F*  (i.e., 
R  (f)  given  in  (15)),  a  rotation  error-like  signal,  denoted  by 
( t )  G  R3 ,  is  defined  by  the  angle  axis  representation  as  follows 
[16] 

e„  =  u6  (27) 

where  u  ( t )  G  R3  represents  a  unit  rotation  axis,  and  6  (f)  G  R 
denotes  the  rotation  about  u(t)  that  is  assumed  to  be  confined 
to  the  following  region  [16] 

—  7 T  <  6  (f)  <  7T.  (28) 


The  parameterization  u  ( t )  0  (t)  is  related  to  the  rotation  matrix 
R  ( t )  by  the  following  expression 


R  =  I3  +  sin  0  [w]  > 


1  r\  •  2 

+  2  sin 


(29) 


where  the  notation  [u]  denotes  the  3x3  skew-symmetric  ma¬ 
trix  associated  with  u(t).  After  some  mathematical  develop¬ 
ment,  the  open-loop  error  dynamics  for  e^(t)  can  be  expressed 
as  follows  [16] 

=  —L^RrLOr  (30) 

where  L u  ( t )  G  R3x3  is  defined  as  follows 


(  \ 

sine  ( 6 ) 

v  sinc2  © ) 


(31) 


Since  the  rotation  matrix  R  ( t )  and  the  rotation  error  ew  (t) 
defined  in  (27)  are  unmeasurable,  an  estimated  rotation  error 
e^(t)  G  R3  is  defined  as  follows 


e„  =  u6  (32) 

where  ii(t)  G  R3,  9  (t)  G  R  represent  the  estimate  of  u(t)  and 
9(t),  respectively.  Based  on  (20),  it  is  clear  that  R(t)  is  sim¬ 
ilar  to  R(t).  By  exploiting  the  properties  of  similar  matrices 
(i.e.,  similar  matrices  have  the  same  trace  and  eigenvalues),  the 
following  estimates  can  be  determined  [14] 

6  =  6  u  =  fj.Au  (33) 


where  fi  G  R  denotes  the  following  unknown  positive  constant 

(34) 

Art 

After  substituting  (33)  into  (32),  e^{t)  can  be  expressed  in  terms 
of  e^(t)  as  follows 

eu  =  fjAe^  (35) 

where  (27)  has  been  utilized.  Given  the  open-loop  rotation  error 
dynamics  in  (30),  the  control  input  ior  ( t )  can  be  designed  as 
follows 

ior  =  A  wR^e^  (36) 

where  G  denotes  a  positive  control  gain,  and  Rr  G  R3>  3 
denotes  a  constant  best-guess  estimate  of  Rr  .  After  substituting 
(36)  into  (30)  for  u jr  ( t ),  the  following  closed-loop  dynamics  can 
be  obtained  [14] 

eu  =  —A  wfiL^RrAe^  (37) 

where  (35)  has  been  utilized,  and  the  rotation  estimate  error 
matrix  Rr  G  R3x3  is  defined  as  follows 

Rr=RrRr-  (38) 


Remark  2:  The  angle  axis  representation  in  (27)  is  not 
unique,  in  the  sense  that  a  rotation  of  —6  (f)  about  —u(t)  is 
equal  to  a  rotation  of  6  ( t )  about  u(t).  A  particular  solution  for 
6  ( t )  and  u(t)  can  be  determined  as  follows 

8P  =  cos"1  Q  (tr  (R)  -  1))  Mx  =  (39) 

where  the  notation  tr(-)  denotes  the  trace  of  a  matrix  and  [iip] 
denotes  the  3x3  skew-symmetric  form  of  up(t).  From  (39),  it  is 
clear  that 

0  <  6P  (f)  <  rr.  (40) 

While  (40)  is  confined  to  a  smaller  region  than  8  (f)  in  (28),  it 
is  not  more  restrictive  in  the  sense  that 


up6p  =  u9. 


(41) 


The  constraint  in  (40)  is  consistent  with  the  computation  of 
[u  (f)]  in  (39)  since  a  clockwise  rotation  (i.e.,  —  7r  <6(t)  <  0) 
is  equivalent  to  a  counterclockwise  rotation  (i.e.,  0  <  6  (f)  <  7r) 
with  the  axis  of  rotation  reversed.  Hence,  based  on  (41)  and 
the  functional  structure  of  the  object  kinematics,  the  particular 
solutions  6P  (t)  and  up(t)  can  be  used  in  lieu  of  8(t )  and  u(t) 
without  loss  of  generality  and  without  confining  6  (t)  to  a  smaller 
region.  Since  we  do  not  distinguish  between  rotations  that  are 
off  by  multiples  of  27r,  all  rotational  possibilities  are  considered 
via  the  parameterization  of  (27)  along  with  the  computation  of 
(39). 

Theorem  1:  The  kinematic  control  input  given  in  (36)  ensures 
that  ew  ( t )  defined  in  (27)  is  exponentially  regulated  in  the  sense 
that 

||eu,(*)|[  <  ||e„(0)||  exp(— A„/r/V),  (42) 

provided  the  following  inequality  is  satisfied 


xT  (^RrA^j  x  >  f30  ||a;||2  for  Vx  G  R3 

where 


/  _  _ \  /  _  \  1  1 

(  RrA  +  (tirA) 

r\ 

(.RrA)  X  =  XT  (-RrA)  X  =  xT 

V  ) 

9 

\  /  \  /  1 

\ 

) 

(43) 


x 

(44) 


for  Vx  G  R3 ,  and  /30  G  R  denotes  the  following  minimum  eigen¬ 
value 


(45) 


Proof:  Details  available  upon  request,  also  see  [14]. 


IV.  New  Translation  Control  Class 

As  stated  previously,  the  contribution  of  this  paper  is  to  ex¬ 
tend  the  class  of  model-free  controllers  developed  in  [14]  to  in¬ 
clude  a  new  set  of  translation  controllers  that  yield  exponential 
stability  results  (as  opposed  to  the  asymptotic  results  presented 
in  [14]).  In  [14],  three  different  sets  of  translation  controllers 
are  developed  including  a  hybrid  controller,  an  alternate  hybrid 
controller,  and  a  model-free  position-based  controller.  In  this 
paper,  we  develop  a  hybrid  translation  controller.  Extensions  to 
the  alternate  hybrid  controller  and  a  model-free  position-based 
controller  can  also  be  developed  (details  available  upon  request). 
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A.  Hybrid  Translation  Control 
A.l  Control  Design 

To  quantify  the  translation  mismatch  between  the  actual  and 
desired  3D  Euclidean  camera  position,  a  hybrid3  translation 
error  signal,  denoted  by  e„  ( t )  G  R3,  is  defined  as  follows 


To  facilitate  the  subsequent  development,  an  estimates  for  (53), 
denoted  by  Lv(t)  G  R3x3,  is  defined  as  follows 


Lv  = 


J~x 


—  1  0  the  1 

0  —1  the  2 

0  0-1 


(55) 


e„  =  me  —  ml  (46) 

where  me  (t)  G  R3  denotes  the  extended  coordinates  of  an  image 
point  on  7r  in  terms  of  F  and  is  defined  as  follows4 


where  mci(i),  me2{t)  were  introduced  in  (50),  and  Z\{t)  G  R 
denotes  an  estimate  of  the  depth  Z\(t).  To  determine  the  esti¬ 
mate  Zi(t),  we  note  that 


mc 


[  me i  (t)  me 2  ( t )  me3  (i)  ] J 


A'i  Yi 

—  —  ln(Zi) 

Zj\ 


(47) 


and  ml  G  R3  denotes  the  extended  coordinates  of  the  corre¬ 
sponding  desired  image  point  on  i r  in  terms  of  F*  as  follows 


m 


* 

e 


mix 

ml  2 

*  lT 

me3  \ 

xt 

zi 

Yx 

zi 

In  (Zl) 

(48) 


where  In  (•)  denotes  the  natural  logarithm.  Substituting  (47) 
and  (48)  into  (46)  yields 


(49) 


where  the  ratio  -pr  can  be  computed  from  (14)  and  the  decom¬ 
position  of  the  estimated  Euclidean  homography  in  (17),  despite 
the  fact  that  the  individual  signals  Zl  and  Z\(t)  are  not  mea¬ 
surable.  To  facilitate  the  subsequent  development,  an  estimate 
for  (49),  denoted  as  ev(t)  E  R3,  is  defined  as  follows 


ev 


me i  -  mix 


rhe2  -  ml2 


T 


(50) 


where  mei{t),  rhe2{t),  mix,  rhl2  G  R  denote  estimates  of 
mei(f),  me2(t),  mh,  ml 2,  respectively,  that  can  be  calculated 
from  (10)  and  (11). 

By  taking  the  time  derivative  of  (49)  and  then  substituting 
(36)  into  the  resulting  expression  for  u>r  (t),  the  following  sim¬ 
plified  error  dynamics  for  e„(f)  can  be  obtained  [15] 

Gy  Ly  RyVy  T  Au,  (A,;  [fr]  X  T  LyyJ  )  Rr&u  (51) 

where  (23),  (38),  and  the  following  fact  have  been  utilized  [16] 


mi  =  —  vc  +  [mi]x  u>c.  (52) 

In  (51),  Lv(t),  LVUJ  ( t )  G  R3x3  denote  the  following  matrices 


Z\  =  —  Z{  (56) 

ai 

where  ax  is  determined  from  the  decomposition  of  the  homog¬ 
raphy  in  (17).  Therefore,  the  estimated  depth  Zx(t)  can  be 
determined  as  follows 

Zx  =  —Z*x  (57) 

ax 

where  Z\  G  R  denotes  a  constant  estimate  of  the  unknown 
depth  Z*.  Given  the  definition  of  Lv(t)  in  (55),  the  following 
inequality  can  be  developed  (details  available  upon  request) 

xT  (LvL^\  x  >  J-^f(mei,  me2)  \\x\\2  for  Mx  Gl3,  (58) 

V  '  zl 

where  f(rhei,me2)  G  R  denotes  the  following  positive  function 
1  2  1  2  1 

f(mei,me2)  =  -mel  +  -rhe2  +  -  (59) 

“5\/(^1  +  ^2  +  1)  -1' 

From  (59),  it  is  clear  that  if  mei(t),  me2{t)  G  Too,  then 
f(mei,me2)  G  Too.  Moreover,  it  can  be  proven  that 
f(rhei,me2)  can  be  lower  bounded  by  a  positive  constant  ci  G  R 
as  follows  (details  available  upon  request) 

f(mei,me2)  >  ci.  (60) 

Based  on  the  structure  of  the  error  system  developed  in 
(51)  and  the  subsequent  stability  analysis,  the  following  hybrid 
translation  controller  can  be  developed 

vr  =  —A  yR^Lyiy  +  ip  (61) 

where  Ry  ,  ev(t),  and  Lv(t)  are  introduced  in  (36),  (50),  and 
(55),  respectively,  and  the  auxiliary  signal  p(t)  G  R3  is  designed 
as  follows 

P  =  (^-knxZl  -  kn2Zx  ||e„||2)  &r  Lyev  (62) 


1  —10  me  i 

Lv  =  —  0  -1  me2 

Zl  0  0  -1 


where  kn l,  kn2  G  R  represent  positive  constant  control  gains, 
(•gg)  and  ^i(t)  is  defined  in  (57).  In  (61),  Xv(t)  G  R  denotes  a 
positive  gain  function  selected  as  follows 


T 


VLO 


meime2  —1  —  mix  me2 
1  +  m22  -mexme2  —me  x 
-me  2  me  x  0 


(54) 


3The  translation  error  introduced  in  (46)  is  described  as  a  hybrid,  be¬ 
cause  it  is  a  composed  of  the  normalized  coordinates  (obtained  from  the 
image-space)  along  with  the  reconstructed  task-space  depth  signal. 

4To  develop  the  translation  controller  a  single  feature  point  can  be  uti¬ 
lized.  Without  loss  of  generality,  the  subsequent  development  will  be 
based  on  the  image  point  Oi,  and  hence,  the  subscript  1  will  be  utilized 
in  lieu  of  i. 


\v  —  knO  + 


Zi2 


/  (m 


el,  77le2 ) 


(63) 


where  kn o  G  R  is  a  positive  constant,  and  f  (mei,me2)  was 
defined  in  (59).  After  substituting  (61)  into  (51)  for  vr(t),  the 
closed- loop  dynamics  for  ev(t)  can  be  obtained  as  follows 


Gy  -  \y  Ly  Ry  Ly  Gy  T  LyRy(p~\~  Xy,  (Ly  [^rj^  T  T'VUj'j  RyOyJ  (64) 

where  (35)  has  been  utilized. 
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Based  on  (10),  (11),  (47),  (48),  and  (50),  the  following  prop¬ 
erty  can  be  determined 


G„  —  BCv 


(65) 


where  B  £  RSx3 
follows 


is  a  constant,  invertible  matrix  defined  as 


B  = 


An  Ai2  0 
0  A22  0 

0  0  1 


(66) 


Furthermore,  based  on  the  special  structure  of  the  matrix  Lv(t) 
and  the  fact  that  A  defined  in  (12)  is  upper-triangular,  B  can 
also  be  expressed  as  follows 


B  =  rjLvALv  1 


(67) 


where  rj  6  R  is  defined  as 


and  Lv  1(t)  is  given  by  the  following  expression 


L-1  =  Zj 


—  1  0  —me  1 

0  —1  —me  2 

0  0-1 


Note  that  by  dividing  (57)  by  (56),  it  is  clear  that 


(68) 


(69) 


Zi 

Z! 


z/_ 

zV 


(70) 


and  hence,  from  (68)  it  is  clear  that  77  is  a  positive  constant. 
After  taking  the  time  derivative  of  (65)  and  substituting  (64) 
into  the  resulting  expression  for  e„(f),  the  closed- loop  dynamics 
for  e„(f)  can  be  obtained  as  follows 


ev  =  —  \vr]LvARrLv  ev  +  r]LvARrip  (71) 

+A WLVA  (ri[tr]x  -  Zi  [mi]xJ  Rre^ 

where  (67),  (68),  and  the  following  equality  have  been  utilized 
L~1LVU1  =  -Zi  [mi]  .  .  (72) 

A. 2  Stability  Analysis 

Theorem  2:  The  kinematic  control  input  given  in  (61)  and 
(62)  ensures  that  the  hybrid  translation  error  signal  e„  (t)  de¬ 
fined  in  (49)  is  exponentially  regulated  in  the  sense  that 

IM0II  <  \/2Co  ||s_1|!  exP(-E^)  (73) 

provided  (43)  is  satisfied,  where  B  is  defined  in  (66),  and  £0, 
Ci  £  R  denote  the  following  positive  constants 


Ci  =  min{2?7/30,  2\wfj,f30} 

where  A,  fi,  /30,  Xw,  and  77  are  defined  in  (12),  (34),  (36),  (45), 
and  (68),  respectively.  In  (74),  S  6  R  denotes  a  positive  constant 
that  can  be  made  arbitrarily  small  by  increasing  values  of  kn 0, 
kni,  k„,2 ■  If  77  =  a  repeated  root  exists  for  ev(t)  and  (74) 
is  modified  as  follows 

Co  =  \  P„  (0)||2  +  (v2  ||a||  ||eUJ(0)||2')  t,  Ci  =  2 vPo- 
Proof:  Details  available  upon  request. 
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